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TITLE 

APPARATUS AND METHOD OF DISPLAYING VIDEO OUTPUT 

BACKGROUND OF THE INVENTION 

Field of the Invention 

5 The present invention relates to a video output 

technology and in particular to an apparatus and 
method of displaying video output with dynamically 
adjustable frame rate. 

Description of the Related Art 

10 The present technology of displaying video output 

includes three essential components which are the 
rendering engine, the playback engine, and the drawing 
engine. The rendering engine processes source frame 
data. The playback engine controls the display rate. 

15 The drawing engine outputs frame data. Fig. 1 is a 
diagram of the present technology of displaying video 
output. First, a playback engine 10 sends a frame 
requirement to a rendering engine 12 . The rendering 
engine 12 then obtains stored source frame data 

2 0 according to the frame requirement. Next, the 

rendering engine 12 processes the source frame data 
and sends the processed frame data back to the 
playback engine 10. Finally, the playback engine 10 
sends the processed frame data to a drawing engine 14 

2 5 to be displayed. 
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The drawing engine 14 remains idle until the 
playback engine 10 sends the frame requirement to the 
rendering engine 12 and the corresponding frame data 
is processed by the rendering engine 12 and sent to 
5 the drawing engine 14 through the playback engine 10. 
The drawing engine 14 is typically idle for a 
relatively long time due to the single- thread 
execution mode, and inefficient use of system 
resources. Additionally, because the data processing 

10 method and the processing time are not controlled, 
frames are unexpectedly dropped. 

Moreover, the present method of processing data 
required to display video output is based on full size 
decoding. Full size decoding is time consuming, and 

15 lengthens data processing. The present filtering of 
video output divides a video frame into an odd frame 
and an even frame, processes the odd and even frame 
separately, and combines the odd and even frames into 
an output frame. The mentioned filtering procedure 

2 0 requires more time process data causing a delay in the 
displayed video output. 

SUMMARY OF THE INVENTION 

Accordingly, an object of the invention is to 
provide an apparatus and method of displaying video 
25 output applicable to multiple systems. The invention 
utilizes a multi-thread execution mode for displaying 
video output, adding a pre-fetch engine and pre-fetch 
buffer to the present method of displaying video 
output. The inventive apparatus and method can reduce 
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drawing engine idle time and inefficient use of system 
resources. The invention adopts the concept of half- 
size for data decoding and frame-base for data 
filtering, solving the problem of the present 
5 technology. 

To achieve the foregoing and other objects, the 
invention discloses an apparatus and method of 
displaying video output with dynamically adjustable 
frame rate to control playback quality. The inventive 

10 apparatus includes a playback engine, a pre-fetch 
engine, a rendering engine, and a drawing engine. The 
playback engine sends a pre-fetch requirement, a 
playback requirement, and target frame data. The pre- 
fetch engine obtains pre-fetch frame data according to 

15 the pre-fetch requirement from the pre-fetch buffer 
and sends the obtained frame data to the playback 
engine. If the pre-fetch frame data according to the 
playback requirement is not stored in the pre-fetch 
buffer, the pre-fetch engine obtains and sends first 

20 playback frame data to the playback engine. The pre- 
fetch engine further receives the pre-fetch 
requirement, obtains second playback data, storing it 
in the pre-fetch buffer, and adjusts the drop rate of 
the first and second playback frame data according to 

25 related conditions. The rendering engine obtains 
stored source frame data, transfers the source frame 
data into first and second playback frame data by 
decoding and filtering, and sends the data to the pre- 
fetch engine. The decoding is half -framed and the 

30 filtering is frame-based. The drawing engine receives 
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the playback requirement and the target frame data 
from the playback engine and outputs the target frame 
data . 

BRIEF DESCRIPTION OF THE DRAWINGS 

5 The present invention can be more fully 

understood by reading the following detailed 
description and examples with references made to the 
accompanying drawings , wherein : 

Fig. 1 is a diagram of the present technology of 
10 displaying video output. 

Fig. 2 is a diagram of an apparatus of displaying 
video output for adjusting drop rate of video frames 
dynamically to control playback quality. 

Fig. 3 is a flowchart of pre -fetch video frame 

15 data. 

Fig. 4 is a flowchart of video frame data 
processing . 

Fig. 5 is a flowchart of displaying video output. 
DETAILED DESCRIPTION OF THE INVENTION 

2 0 As summarized above, the present invention 

discloses an apparatus and method of displaying video 
output with dynamically adjustable frame rate to 
control playback quality. The inventive apparatus 
comprises a playback engine, a pre -fetch engine, a 

2 5 rendering engine, and a drawing engine. 

The playback engine sends a pre- fetch 
requirement, a playback requirement, and target frame 
data. The playback engine also controls the display 
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rate of video frames and sends the pre -fetch 
requirement to the pre -fetch engine during idle time. 

The pre- fetch engine is coupled to the playback 
engine and comprises a pre-fetch buffer. The pre- 
5 fetch engine receives the playback requirement. The 
pre-fetch engine obtains pre-fetch frame data from the 
pre-fetch buffer according to the playback requirement 
and sends the obtained pre-fetch frame data to the 
playback engine. If the pre-fetch frame data 

10 according to the playback requirement is not stored in 
the pre-fetch buffer, the pre-fetch engine obtains 
first playback frame data and sends the obtained first 
playback frame data to the playback engine. 

The pre-fetch engine further receives the pre- 

15 fetch requirement, obtains second playback data, and 
stores it in the pre-fetch buffer. The pre-fetch 
engine also adjusts the drop rate of the first and 
second playback frame data according to related 
conditions. The related conditions comprise video 

20 frame processing time, real-time display definition 
time, and pre-fetch buffer size. 

The rendering engine, coupled to the pre-fetch 
engine, obtains stored source frame data, transfers 
the source frame data into the first and second 

2 5 playback frame data by decoding and filtering, and 

sends the processed frame data to the pre-fetch 
engine. Regarding decoding, the invention utilizes a 
half -frame as the data processing unit, thus reducing 
the data processing area by one quarter when compared 

3 0 to the present decoding method. The reduced data 
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processing area greatly reduces processing. Regarding 
filtering, the invention utilizes a frame-based method 
to simplify the data processing procedure and also 
further reduces processing time. 
5 The drawing engine, coupled to the playback 

engine, receives the playback requirement and the 
target frame data from the playback engine and outputs 
the target frame data. The target frame data includes 
video and audio data. The drawing engine comprises a 

10 plug-in output module. The plug-in output module is 
an independent module attached to the drawing engine 
for outputting data frames. 

The main concept of the invention is to pre -fetch 
the desired video frames and store the pre- fetched 

15 video frames into the pre- fetch buffer during idle 
time. Thus, the desired display frames can be 
smoothly displayed because the desired display frames 
are already stored in the pre- fetch buffer. 

Moreover, the invention provides a method of 

2 0 displaying video output with dynamically adjustable 
frame rate to control playback quality. The method 
first provides a playback engine, a pre- fetch engine, 
a rendering engine, and a drawing engine. The pre- 
fetch engine comprises a pre-fetch buffer. The pre- 

2 5 fetch engine and the drawing engine are capable of 

multi -thread execution. The drawing engine comprises 
a plug- in output module, attached to the drawing 
engine for outputting data frames. The playback 
engine sends the pre-fetch requirement during idle 

3 0 time. 
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Next, the playback engine sends a requirement, 
i.e. a playback requirement or a pre- fetch requirement 
to the pre-fetch engine. The pre-fetch engine 

recognizes the received requirement as a playback 
5 requirement or a pre-fetch requirement. If the 

received requirement is a playback requirement, the 
pre-fetch engine obtains pre-fetch frame data from the 
pre-fetch buffer according to the playback requirement 
and sends the obtained frame data to the playback 

10 engine. If the frame data according to the playback 
requirement is not stored in the pre-fetch buffer, the 
pre-fetch engine sends the playback requirement to the 
rendering engine . 

The rendering engine further obtains first source 

15 frame data according to the playback requirement, 
transfers the first source frame data into first 
playback frame data by decoding and filtering, and 
sends the processed first playback frame data to the 
pre-fetch engine. Here, the decoding and the 

20 filtering are half-framed and frame-based 
respectively, as previously mentioned. 

The pre-fetch engine then sends the received 
first playback frame data to the playback engine and 
adjusts the frame drop rate according to related 

25 conditions of the first playback frame data. The 
related conditions comprise video frame processing 
time, real-time display definition time, and pre-fetch 
buffer size. The video frame processing time affects 
the drop rate of video frames. The real-time display 

30 definition time affects pre-fetching efficiency. The 



7 



Client's ref.: 2002-14 

File : 0599-9151-US/Final/Teresa/Steve 

size of the pre-fetch buffer affects the pre-fetch 
result. Therefore, the three factors should be 

considered as a whole. 

The playback engine transfers the first playback 
frame data into target frame data and sends the target 
frame data to the playback engine. The playback 
engine initiates the plug- in output module to output 
the target frame data, including video and audio data. 

In the beginning, if the pre-fetch engine 
recognizes the received requirement from the playback 
engine as a pre-fetch requirement, the pre-fetch 
engine sends the pre-fetch requirement to the 
rendering engine. The rendering engine then obtains 
second source frame data according to the pre-fetch 
requirement. The rendering engine also transfers the 
second source frame data into second playback frame 
data by decoding and filtering. The processed second 
frame playback data is then sent to the pre-fetch 
engine . 

The pre-fetch engine stores the second playback 
frame data in the pre-fetch buffer and adjusts the 
frame drop rate according to related conditions of the 
second playback frame data. Again, the related 
conditions comprise frame processing time, real-time 
display definition time, and the pre-fetch buffer 
size. All the related conditions should be considered 
as a whole . 

Thus, an apparatus and method of displaying video 
output with dynamically adjustable frame rate to 
control playback quality is provided. The invention 
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is capable of mult i -thread execution, that is, the 
pre-fetch engine can execute in parallel with the 
drawing engine, greatly reducing drawing engine idle 
time . 

5 Fig. 2 is a diagram of an apparatus for 

displaying video output with dynamically adjustable 
frame rate to control playback quality. In one 
embodiment, the inventive apparatus comprises a 
playback engine 20, a pre-fetch engine 22, a rendering 

10 engine 26, and a drawing engine 24. 

The playback engine 2 0 sends a pre-fetch 
requirement, a playback requirement, and target frame 
data. The playback engine 2 0 controls the display 
rate of video frames and sends the pre-fetch 

15 requirement to the pre-fetch engine 22 during idle 
time . 

The pre-fetch engine 22 is coupled to the 
playback engine 2 0 and comprises a pre-fetch buffer 
28. The pre-fetch engine 22 obtains pre-fetch frame 

20 data from the pre-fetch buffer 28 and sends the 
obtained pre-fetch frame data to the playback engine 
20. If the pre-fetch frame data according to the 
playback requirement is not stored in the pre-fetch 
buffer 28, the pre-fetch engine 22 obtains and sends 

25 first playback frame data to the playback engine 20. 

The pre-fetch engine 22 further receives the pre- 
fetch requirement, obtains second playback data, and 
stores it in the pre-fetch buffer 28. The pre-fetch 
engine 22 also adjusts the drop rate of the first and 

3 0 second playback frame data according to related 
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conditions. The related conditions comprise video 
frame processing time, real-time display definition 
time, and pre-fetch buffer size. 

The rendering engine 26, coupled to the pre-fetch 
5 engine 22, obtains stored source frame data, transfers 
the source frame data into the first and second 
playback frame data by decoding and filtering, and 
sends the processed frame data to the pre-fetch engine 
22. Regarding decoding and filtering, the invention 

10 utilizes half-frame and frame-base as the data 
processing unit, respectively. 

The drawing engine 24, coupled to the playback 
engine 20, receives the playback requirement and the 
target frame data from the playback engine 2 0 and 

15 outputs the target frame data. The target frame data 
includes video and audio data. The drawing engine 24 
comprises a plug-in output module 30. The plug-in 
output module 3 0 is an independent module attached to 
the drawing engine 24 for outputting data frames. 

2 0 Fig. 3 is a flowchart of pre-fetch video frame 

data. A method of displaying video output with 
dynamically adjustable frame rate to control playback 
quality is provided. In one embodiment, the method 
first provides a playback engine, a pre-fetch engine, 

25 a rendering engine, and a drawing engine. The pre- 
fetch engine comprises a pre-fetch buffer. The pre- 
fetch engine and the drawing engine are executed in 
multi -thread . The drawing engine comprises a plug-in 
output module, attached to the drawing engine for 
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outputting data frames. The playback engine sends the 
pre-fetch requirement during idle time. 

The playback engine sends a requirement, i.e. a 
playback requirement or a pre-fetch requirement. The 
5 pre-fetch engine will recognize the received 
requirement as a playback requirement or a pre-fetch 
requirement. If the pre-fetch engine recognizes the 
received requirement from the playback engine as a 
pre-fetch requirement (step S300) , the pre-fetch 

10 engine sends the pre-fetch requirement to the 
rendering engine and arranges a pre-fetch space (step 
S3 02) . The rendering engine then obtains second 
source frame data according to the pre-fetch 
requirement. The rendering engine transfers the 

15 second source frame data into second playback frame 
data by decoding and filtering (step S3 04) . The 
processed second playback frame data is sent back to 
the pre-fetch engine. 

The pre-fetch engine stores the second playback 

20 frame data into the pre-fetch buffer (step S306) . The 
pre-fetch engine also adjusts frame drop rate 
according to related conditions of the second playback 
frame data. 

The adjustment is described as follows. First, 
25 the pre-fetch engine verifies frame data processing 
time (step S308) . Next, the pre-fetch engine 

considers frame data processing time, real-time 
display definition time, and the pre-fetch buffer size 
to determine the displaying will be executed in a 
30 smooth or real-time way (step S310) . If the 
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displaying is determined to be real-time (step S312) , 
then the drop rate is not be adjusted. If the 
displaying is determined to be smooth (step S3 14) , 
then the drop rate is adjusted (step S316) . Finally, 
the next frame to be displayed is obtained. 

Fig. 4 is a flowchart of data processing of video 
frame data. If the received requirement is the 
playback requirement, the pre -fetch engine obtains and 
sends pre -fetch frame data according to the playback 
requirement from the pre -fetch buffer to the playback 
engine. If the frame data according to the playback 
requirement is not stored in the pre-fetch buffer, the 
pre -fetch engine sends the playback requirement to the 
rendering engine. 

The rendering engine obtains first source frame 
data according to the playback requirement (step 
S400) , transfers the first source frame data into 
first playback frame data by decoding (step S4 02) and 
filtering (step S404) , and sends the processed first 
playback frame data to the pre-fetch engine (step 
S406) . 

Fig. 5 is a flowchart of video output displaying. 
The pre-fetch engine then sends the received first 
playback frame data to the playback engine and adjusts 
frame drop rate according to related conditions of the 
first playback frame data. The playback engine 
transfers the first playback frame data into target 
frame data and sends the target frames data to the 
playback engine (step S500) . The playback engine 
initiates the plug-in output module (step S502) to 
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output the target frame data (step s504) , including 
video and audio data. 

Thus, an apparatus and method of displaying video 
output with dynamically adjustable frame rate to 
5 control playback quality is provided. The inventive 
apparatus and method utilizes a multi-thread execution 
mode to pre-fetch display frame data and adjust 
display drop rate to reduce system idle time, 
enhancing smoothness of display. Specifically, the 

10 invention can be applied to different display systems, 
achieving the objects of the invention. 

It will be appreciated from the foregoing 
description that the apparatus and method described 
herein provide a dynamic and robust solution to the 

15 video output displaying problem. If, for example, the 
data processing method or displaying method is 
altered, the apparatus and method of the present 
invention can be revised accordingly. 

While the invention has been described by way of 

2 0 example and in terms of the preferred embodiments, it 
is to be understood that the invention is not limited 
to the disclosed embodiments. To the contrary, it is 
intended to cover various modifications and similar 
arrangements (as would be apparent to those skilled in 

2 5 the art) . Therefore, the scope of the appended claims 
should be accorded the broadest interpretation so as 
to encompass all such modifications and similar 
arrangements . 
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